Differentiability Implies Continuity in Neuronal Dynamics 
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Recent work has identified nonlinear deterministic structure in neuronal dynamics using periodic 
orbit theory. Troublesome in this work were the significant periods of time where no periodic orbits 
were extracted - "dynamically dark" regions. Tests for periodic orbit structure typically require 
that the underlying dynamics are differentiable. Since continuity of a mathematical function is a 
necessary but insufficient condition for differentiability, regions of observed differentiability should 
be fully contained within regions of continuity. We here verify that this fundamental mathematical 
principle is reflected in observations from mammalian neuronal activity. First, we introduce a null 
Jacobian transformation to verify the observation of differentiable dynamics when periodic orbits 
are extracted. Second, we show that a less restrictive test for deterministic structure requiring only 
continuity demonstrates widespread nonlinear deterministic structure only partially appreciated 
with previous approaches. 



PACS 5.45.Tp; 87.17.Nn; 87.18.Sn 
Much progress has been made in recent years detecting 
deterministic dynamics within noisy experimental envi- 
ronments EL Traditionally, counting measures such as 
interspike interval histograms have been used to examine 
the distributions of neuronal firing times, and models of 
activity have assumed that fluctuations about the mean 
rates are stochastic j2|. Since both action potential gen- 
eration and synaptic transmission are highly nonlinear 
processes, it is reasonable to assume that some of the 
fluctuations about neuronal mean firing rates are not gen- 
erated from linear stochastic dynamics. Indeed, we have 
come to recognize that fluctuations in spike timing may 
appear deterministic, and that stochastic models may fail 
to account for neuronal timing || . If neurons do indeed 
generate such detailed patterns of activity, our concept of 
how neuronal networks process information may require 
radical reinterpretation Q . 

Gaining a better understanding of the behavior of a 
complicated dynamical system, which is differentiable 
near periodic orbits, has a celebrated history that reaches 
back over a century in celestial || , and quantum mechan- 
ics (6|. Chaotic systems possess an infinite number of 
invariant unstable periodic orbits 0. Although charac- 
terizing an infinite number of periodic orbits is impossible 
for real systems, there are three important features of the 
shorter orbits: 1) they are the ones most experimentally 
accessible, 2) the long term average behavior of such sys- 
tems can be well approximated through them j^] , and 3) 
they can be used for predicting Q and controlling such 
systems 

It has recently been shown that periodic orbits can 
be identified within the neuronal activities from a broad 
range of hierarchical neuronal organization, from single 
cells through large ensembles |l2]Jl3] ]. A still unresolved 
issue for the extraction of periodic orbits from neuronal 
systems Jl^,[l4| , are the "dynamically dark" regions - sig- 
nificant time intervals where no periodic orbits seem to 



exist. We would anticipate that such highly structured 
dynamical features such as periodic orbits would not arise 
from a completely stochastic sea of activity, and then 
disappear suddenly. Indeed, since periodic orbits are 
hallmarks of deterministic activity, it is logical to pre- 
sume that they arise from an underlying deterministic 
process, and become visible whenever either the noise 
within the system transiently decreases, or when the sys- 
tem approaches a particularly easy orbit to observe (e.g. 
an especially short one) . We hypothesize that in the pro- 
cess of detecting periodic orbits, the apparently empty 
periods between resolved orbits Jl^,|l4| contain structure 
that remains unobserved. We seek an explanation for 
this dynamical "dark matter" . 

A common feature shared among many of the recently 
developed methods for the extraction of periodic orbits 
from experimental data is the implicit assumption that 
the underlying dynamics are differentiable |f^,[l(| . If the 
dynamics are differentiable it is a necessary condition 
that the underlying function is continuous |17|. Peri- 
ods of detected differentiability should therefore be fully 
contained within periods of continuity. Since continuity 
is a less restrictive criterion for determinism than differ- 
entiability (and should be easier to observe experimen- 
tally) , we predict that regions of observed differentiability 
should arise from a more extensive background of conti- 
nuity. Continuity should shed light on dynamically dark 
regions. 

Transverse hippocampal slices 350-400 fim thick were 
prepared from rat brain using techniques previously de- 
scribed pd| | . Slices were perfused in an interface chamber 
at 3 ml/min with artificial cerebrospinal fluid (ACSF, 
composed of, in mM, 155 Na+, 136 CP", 3.5 K+, 1.2 
Ca 2+ , 1.2 Mg 2 +, 1.25 PO 2- , 24 HCO^, 1.2 SO^ 4 , and 
10 dextrose), at 34.5-35.1 °C. Extracellular field poten- 
tials were recorded differentially using saline-filled mi- 
cropipettes (2-4MQ). After a 90 min acclimation pe- 
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riod the perfusate was changed to one containing one of 
four high [K + ] concentrations: 7.5mM, 8.5mM, 9.5mM, 
or 10.5mM, inducing spontaneous population burst-firing 
events within the network Jl8| . A typical example of such 
stereotyped neuronal population burst-firing is shown in 
Fig. 1. The times of onset of these events were extracted, 
and the interevent time intervals between burst-firings 
used for analysis. All animal experiments were approved 
by the institutional animal care and use committee of 
George Mason University. 

Delay coordinate embedding [|l9| was used to recon- 
struct the underlying dynamics from these interburst in- 
tervals. To extract the unstable periodic orbits from re- 
constructed state space, a transformation based on ob- 
served local dynamics was applied ||,|| that concen- 
trates the data density near the periodic orbits. In the 
limit of noise free dynamics the probability distribution 
function of the transformed data will be singular at the 
periodic points |l(J. This reduces extraction of periodic 
orbits from experimental data to searching for peaks in 
the distribution of the transformed data. The concen- 
tration effect of this transformation, a "dynamical lens" , 
depends implicitly on the existence of differentiable dy- 
namics in the underlying dynamical function. 

To illustrate why this is so, we use the transformation 
to extract a period one orbit from the one-dimensional 
discrete-time dynamical system x n +\ — f(x n ), where 
f(x n ) is the function that prescribes the evolution of the 
system state x n (in practice we use higher dimensional 
state space and dynamics, and extract higher period or- 
bits p^|). We assume that the dynamics described by 
the function f{x) is unknown to us but that the local 
behavior of the dynamics, f'(x n ) = df(x n )/dx, can be 
estimated from a local least squares fit to the experi- 
mental data. The transform g(x n ,K) of x n for period-1 
orbits x* : f(x*) = x* is then defined as g(x n ,K) = 
^"T-sO^Ib)"" 1 ' where s(x„,k) = f[x n ) +k- (x n -a;„_i) 
is a function defined by the estimated local dynamics 
f'(x n ) and by k, an adjustable parameter of the trans- 
form. In practice, we use an ensemble average of densities 
of g(x n ,K,), made with different randomly chosen values 
for k. Significance of the observed peaks is then esti- 
mated by comparison with the transformed densities of 
Amplitude Adjusted Fourier Transform surrogates p0| , 
via the statistics of extremes plfl . In particular, we es- 
timate the probability that observed peaks in the trans- 
formed density are larger than the largest peaks observed 
in the surrogates. We employed between thirty and fifty 
surrogates for the analyses presented here, and only ac- 
cepted peaks that lay entirely outside the distribution of 
maximal surrogate peaks. We estimate a resulting con- 
fidence limit of falsely identifying a periodic orbit of less 
than 3%. 

Note that peaks in the transformed density can be at- 
tributed to two main factors: first from a high density of 



points in the original data in recurrent positions - points 
that already appear periodic; and second from the con- 
centrating effect of the transformation - points that map 
under the transformation closer to the periodic points. 
The latter effect requires successful estimation of the lo- 
cal derivatives of the function. A modification of this 
transformation that only detects recurrent positions is 
achieved by setting the terms corresponding to the esti- 
mates of the local derivatives to zero - a null Jacobian 
transformation [ p2[ . If, in the above one-dimensional 
analysis, we set f'(x) = 0, the transformation reduces to 
g(x n , k) — x n -i + t 1 ,_i — . We see that for recur- 

rent points, i.e. {x n — x n -i) — ► 0, the result approaches 
g(x n ,n) — > x n -i , independent of k. On the other hand, 
for (x n — x n -i) large, g{x n , k) — > x„_i — i, which yields 
points broadly distributed as k is varied. By comparing 
the densities from these two transformations we distin- 
guish whether peaks in the transformed density occur due 
just to recurrence in the original data, an aspect not well 
preserved by the surrogates, or are enhanced due to rea- 
sonable estimates of the local derivatives of the function. 
This null Jacobian transformation requires no surrogate 
data for validity, and is independent of the continuity test 
applied below. 

If the dynamics of these neurons could be accounted 
for by a mean rate with stochastic fluctuations, a linear 
stochastic model derived from the autocorrelation analy- 
sis would best fit our data Q . The frequency of periodic 
orbit detections in each experimental group is indicated 
in Table 1. At higher levels of [K + ], all of the experi- 
ments demonstrated periodic orbit structure that could 
not be accounted for by linear properties. 

In 100% of cases where we detected periodic orbits, 
our estimated Jacobian matrices enhanced the density 
of points compared with null Jacobian transformations 
(Table 1). The typical amplification of the density peaks 
through the use of the estimated rather than null Jaco- 
bian matrices was approximately 5 (range 1.5 - 2100). 
Fig. 2 illustrates an example of the concentration effect 
of these estimated Jacobian matrices. These results help 
validate the presence of meaningful differentiable dynam- 
ics associated with our identified periodic orbits. 

We next applied a test for functional continuity to 
these data p4| . Continuity of a function requires that 
nearby points in the domain of definition of a function 
will be mapped close to each other in its range [jlT]]. In 
a complicated linear or nonlinear function, with or with- 
out noise, it may be difficult to see the close evolution 
of nearby trajectories since such close encounters may 
be rare or "exceptional" [Q. Nevertheless, when found 
these closely tracking points unmistakably reveal that a 
deterministic process is at hand. We employ a method 
which is sensitive enough to detect the (piecewise) con- 
tinuity in a computer "random" number generation al- 
gorithm in common use |24|. If we have truly found dif- 
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ferentiability in certain data windows, indicated by the 
existence of periodic orbits, these regions must be sub- 
sets of regions of continuity that are at least as large as 
the differentiable regions. Moreover, although regions of 
observed differentiability should frequently be contigu- 
ous with regions of continuity, the converse should not 
be valid; that is, regions of continuity might stand alone 
without contiguous regions of detected differentiability. 

Following p4j we searched for all pairs of points in 
reconstructed state space less than S distance apart, 
\\X n — X m \\ < 6, n m, and then measured the distance 
e between the images of these pairs of points one interval 
into the future, ||^ n +l ~ -^m+i]] = £ - The average e for 
a given S, e(S), is e(6) = ^ ]T \\X n+1 - X m+1 \\ , for 

n,m 

all n, m such that \\X n — X m \\ < <5, where N is the total 
number of pairs satisfying the inequality \\X n — X m \\ < 
6, and || • || is the Euclidean norm. We then generated 
100 surrogate data sets and determined how many sur- 
rogate sets have an e less than or equal to the e obtained 
for the experimental data at a given S. One-tailed para- 
metric estimates of confidence limits are generated by the 
percentage of surrogate results with smaller e than the 
experimental data. 

Significant continuity was identified in all data win- 
dows with significant periodic orbits (Table 1). The 
surrogate data test for significance makes it unlikely 
that such evidence for functional continuity could be ac- 
counted for by the linear stochastic properties of the in- 
tervals. As predicted above, we observed that regions 
with differentiability, containing periodic orbits, were 
subsets of and therefore contiguous with regions where 
only continuity was found. Furthermore, regions with 
highly significant continuity were found widespread, not 
necessarily associated with differentiable areas. As ex- 
pected, regions with differentiability without continuity 
were not encountered. Whereas significant periodic or- 
bits were detected in 15-24% of the data time windows, 
the length of time occupied by significant continuity in 
these experiments was more than twice this amount. A 
typical example of the intermingling of regions with con- 
tinuity and differentiability from these experiments is il- 
lustrated in Fig. 3. 

These data provide compelling evidence that the fluc- 
tuations about the mean burst rate of these neuronal net- 
works are frequently deterministic. Periodic orbits reveal 
only a fraction of the amount of nonlinear deterministic 
behavior detectable in these systems. The degree of non- 
linear deterministic activity increased as [K + ] increased. 
We made these observations despite having used neuronal 
networks cut off from their natural inputs and stimula- 
tion patterns, perhaps the worst condition for detecting 
structure in neuronal dynamics |2f| . 

There are many features in biological systems that 
limit the resolvability of differentiability and hence pe- 



riodic orbits. Biological systems are nonstationary, and 
this is reflected in our data in the disparity between the 
percentage of experiments (50-100%) versus percentage 
of data windows (15-24%), within which periodic orbits 
were identified (Table 1). Nevertheless, our use of rela- 
tively small data windows (128 interburst intervals, 2- 
3 minutes of data) reduces the effect of nonstationarity 
on our analysis. On the other hand, our ability to re- 
solve differentiable maps from experimental systems will 
be constrained by such finite sampling of the underly- 
ing dynamical function. We therefore remain cautious in 
equating our ability to resolve periodic orbits with ex- 
istence of differentiability in the underlying dynamics. 
Nevertheless, our null Jacobian results are fully consis- 
tent with the observation of differentiability from these 
experiments. 

Our dynamical "dark matter" is therefore revealed to 
contain functions drawn from the set of continuous (or 
piecewise continuous) mathematical functions. In addi- 
tion, our findings lend further validity to previous find- 
ings of periodic orbits within such dynamics. From a 
practical point of view in handling experimental data, 
continuity is a less restrictive feature in the functional 
representation of a dynamical system than is differentia- 
bility, and is easier to detect. If the goal is to demonstrate 
determinism in experimental data, continuity appears to 
be a better test than periodic orbit extraction. 
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TABLE I. Summary of experimental results. [K + ] = potas- 
sium concentration in perfusate; N = number of experiments; 
W = number of data windows; UPOs = unstable periodic or- 
bits; Enhancement indicates enhanced density about candi- 
date UPOs. To enhance sensitivity, and compensate for non- 
stationarity, periodic orbits were identified using overlapping 
128 point data windows. Statistics in Table 1 are reported 
for non-overlapping windows in order to ensure that windows 
and periodic orbits were not over counted. 
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FIG. 1. Typical extracellular recording of voltage deflec- 
tions corresponding to network burst firing in a population 
of neurons. Calibration bars: voltage (mV) and time (sec). 
Intervals Ii determined from onset times as shown. 

FIG. 2. Example of transformed data density histogram 
used to isolate periodic orbits. Thick solid line is experimen- 
tal result using full transform (recurrence plus differentiabil- 
ity), thin solid line is experimental density from transform 
using null Jacobian (recurrence), and dotted line is mean of 
the surrogate data densities using full transform. Data from 
experiment at 10.5 mM [K + ]. Highest peak indicates periodic 
orbit. The increase in amplification of this peak due to the es- 
timated Jacobian matrix was approximately four-fold, typical 
of results. This amplified peak lay outside of the distribution 
of surrogate peaks. 

FIG. 3. Simultaneous comparison of observation of peri- 
odic orbits (indicated by triangles) with significant continuity 
(gray scale). Abscissa indicates window number for experi- 
ment, equivalent to time. Ordinate indicates values of e in 
arbitrary units. Gray scale represents probability that func- 
tional continuity is significant, with dark gray revealing less 
than 5% chance of finding continuity in the surrogates. Since 
these statistics are on a pixel by pixel basis, confluently gray 
regions represent continuity with much greater than 95% con- 
fidence. Data windows represent 128 interspike intervals, with 
neighboring windows overlapped 126 intervals. The two pe- 
riodic orbits indicated were period- 1 orbits, centered about 
960 and 985 msec respectively. Note that each periodic or- 
bit is contained in time within a larger period of continuity, 
and that substantial regions of continuity are present within 
which no differentiability is identified. 
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